feat: Display JSON columns in anywidget mode #2138
Draft
+250
−13
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
product-auto-label
bot
added
size: s
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
product-auto-label
bot
added
size: m
tswast
reviewed
Oct 6, 2025
tswast
requested changes
Oct 6, 2025
shuoweil
force-pushed
the
shuowei-anywidget-col
branch
2 times, most recently
from
43a938c to
4a33ccf
Compare
tswast
reviewed
Oct 15, 2025
tswast
reviewed
Oct 15, 2025
tswast
reviewed
Oct 15, 2025
shuoweil
force-pushed
the
shuowei-anywidget-col
branch
from
30dfa7d to
237c134
Compare
tswast
reviewed
Oct 15, 2025
Comment on lines
786
to
788
| # anywdiget mode uses the same display logic as the "deferred" mode | ||
| # for faster execution | ||
| if opts.repr_mode in ("deferred", "anywidget"): |
shuoweil
force-pushed
the
shuowei-anywidget-col
branch
from
f18fd9e to
8601e52
Compare
product-auto-label
bot
added
size: l
shuoweil
force-pushed
the
shuowei-anywidget-col
branch
from
533541a to
860db3e
Compare
product-auto-label
bot
added
size: m
shuoweil
changed the title
This commit migrates the `round_op` operator from the Ibis compiler to the SQLGlot compiler.
* add error handling for audio_transcribe * add error handling for pdf functions * add eror handling for image functions * final touch * restore rename * update notebook to better reflect our new code change * return None on error with verbose=False for image functions * define typing module in udf * only use local variable * Refactor code
* feat: support INFORMATION_SCHEMA tables in read_gbq * avoid storage semi executor * use faster tables for peek tests * more tests * fix mypy * Update bigframes/session/_io/bigquery/read_gbq_table.py * immediately query for information_schema tables * Fix mypy errors and temporarily update python version * snapshot * snapshot again
product-auto-label
bot
added
size: xl
This reverts commit db5d8ea.
product-auto-label
bot
added
size: l
shuoweil
changed the title
product-auto-label
bot
added
size: m
shuoweil
changed the title
shuoweil
changed the title
shuoweil
changed the title
product-auto-label
bot
added
size: l
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
When displaying a DataFrame containing JSON columns (including nested JSON in lists or structs), the
anywidgettable would fail to render and fall back to the "Computation deferred" message.This was caused by a limitation in PyArrow (apache/arrow#45262), which raises an
ArrowNotImplementedErrorwhen attempting to create an empty Arrow array from an extension type likedb_dtypes.JSONArrowType. TheTableWidgetinitialization triggers this error when creating an empty DataFrame to build the table structure before fetching data.This commit introduces a workaround in
bigframes.core.blocks.to_pandas_batches. Before creating the empty DataFrame for the widget, the code now:JSONArrowTypein the schema withpyarrow.stringto create a "safe" dtype.pandas.Seriesusing this safe dtype.This approach avoids the PyArrow error while preserving the correct schema for the DataFrame.
Additionally, the existing conversion of JSON data to strings in
bigframes.session.executor.pyis retained to handle data correctly during processing after it is fetched from BigQuery.Fixes #<448126500 and 453561268> 🦕